Programmed classroom instruction

ABSTRACT

A computer-implemented method of overseeing and adjusting the instruction and evaluation of a student with respect to one or more topics of study within a classroom. The subject matter of an academic course is studied and broken down into a plurality of discretely defined behavioral performances designed to be readily and objectively recognized as being mastered or not by a student. One or more of the discretely defined behavioral performances are then selected, with the aid of a first computerized database system, as learning objectives for the week. At the end of the week, a student is subsequently evaluated on these objectives. Results of the evaluation are then transferred to a second computerized database system, which organizes the collected data into an interactive learning management report that can be configured by a reviewer in real time to display a variety of levels of detail.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. Ser. No. 11/190,176, filedJul. 26, 2005 now abandoned, which is a continuation-in-part of ourapplication Ser. No. 11/025,653, filed Dec. 29, 2004 now U.S. Pat. No.8,275,305, and entitled “PROGRAMMED CLASSROOM INSTRUCTION”.

FIELD OF THE INVENTION

The present invention generally relates to a system of management ofeducation suitable with conventional classrooms and schools byadaptation of the teaching and learning process into a programmeddigital process compatible with advances in information technology. Morespecifically, the present invention describes an integrated set ofmethods and instruments useful for the continuous oversight andadjustment of the classroom educational process.

BACKGROUND OF THE INVENTION

In recent years, innovative practices in general education have begun toemphasize learning methods characterized by higher degrees ofspecificity. Course syllabi may be divided into dozens, even hundreds ofdetailed teaching/learning units. The influences fostering these effortsderive from several different sources. Personnel management planningsometimes attempts to spell out instructional responsibilities toteachers for the school year. Alternatively, efforts by academicdesigners have led to development of precise instructional sub routinessuch as programmed texts.

Though detailed teacher job assignments provide more careful expositionof performance expectations, there has been a universal failure toprovide adequate instruments and methods for tracking the more elaborateperformances expected. Alternatively, previous attempts to develop thetechnically advanced learning guidance and assessment systems such asprogrammed texts, have produced materials for individual student use butoffer no system of teacher support and guidance in normal classroomcircumstances.

The present method adapts and integrates features from these differentgenres to produce a unique multi part system of detailed managementinfluence and oversight suited to conventional classroom and schoolsettings.

SUMMARY OF THE INVENTION

An integrated system and set of methods for the continuous oversight andadjustment of the classroom educational process. Included within thesystem and set of methods is 1) a particular system and method ofprecise fractionation of educational goals into discrete units bestsuited for learning. 2) A system and method for standardizing andorganizing the discrete learning units into teaching and learningprocedures. 3) A system and method for accurately observing andmeasuring and improving learning progress of these discrete learningunits. 4) A system and method for automatically analyzing and thenfrequently presenting to remotely located managers, a completedescription of the progress and current achievement levels of individualstudents, classroom groups, and entire schools. This system and set ofmethods in summary is termed—PROGRAMMED CLASSROOM INSTRUCTION.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a partial list of “reading” learning units that are the resultof a process of fractionation of educational subject matter, that, whentaken as a whole, define the reading skills that, upon selection, becomethe teaching and learning objectives for reading for a first gradestudent.

FIG. 2 is a partial list of “science” learning units that are the resultof a process of fractionation of educational subject matter, that, whentaken as a whole, define science skills that, upon selection, become theteaching and learning objectives for science for a first grade student.

FIG. 3 is a partial list of “social studies” learning units that are theresult of a process of fractionation of educational subject matter,that, when taken as a whole, define the social studies skills that uponselection become the teaching and learning objectives for Social Studiesfor a first grade student.

FIG. 4 is an illustration of the WEEKLY PREVIEW portion of the presentinvention. Following teacher selection of learning units from thecomputer library (lesson plan), as teaching objectives for the followingweek, and installing any parent communications, the plan is printed asthe WEEKLY PREVIEW and distributed to all parents.

FIG. 5 is an illustration of the WEEKLY EVALUATION REPORT portion of thepresent invention. Following weekly observation, detection and computerentry of completed learning (mastery) of learning units, results areautomatically printed as this report and delivered to parents.

FIG. 6 is an illustration of the Classroom Teaching Chart portion of thepresent invention. Following selection of the weekly learningobjectives, the instructor may call up, and adjust, as learningprogresses, this display of current learning status for each child andfor the entire classroom, and for each selected learning objective.

FIG. 7 is an illustration of the QUARTERLY PROGRESS REPORT portion ofthe present invention, such as are distributed to parents.

FIG. 8 is a flow diagram of the serial order andgeneralization-specialization options of the data presentations of theLEARNING MANAGEMENT REPORT of the present invention.

FIG. 9 is an illustration of the introductory panel of the LEARNINGMANAGEMENT REPORT of the present invention.

FIG. 10 is an illustration of the STUDENT LOG generated by the LEARNINGMANAGEMENT REPORT of the present invention.

FIG. 11 is an illustration of the STUDENT DIGEST generated by theLEARNING MANAGEMENT REPORT of the present invention.

FIG. 12 is an illustration of the STUDENT/CLASS PERFORMANCE RANGESgenerated by the LEARNING MANAGEMENT REPORT of the present invention.

FIG. 13 is an illustration of the CLASSROOM LOG generated by theLEARNING MANAGEMENT REPORT of the present invention.

FIG. 14 is an illustration of the CLASSROOM DIGEST generated by theLEARNING MANAGEMENT REPORT of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

I. Defining the Measurable Components of Knowledge in Digital Format

The present invention begins by the establishment of a computer assistedmethod of designating precisely the exact components of knowledge andtheir organization which constitutes a desirable state of education andskill for a particular grade level and subject matter in generaleducation. The required analysis selects discrete, observable, behaviorswhich represent, when learned, complete knowledge elements and/orcombinations of elements. The process further organizes these knowledgeelements according to structural and functional groupings as well asconventional levels of advancement. The result of this definitionalprocess is the establishment of a large group of unique, individuallydescribed behaviors or learning units, which are so specific that ateacher can select any one as an explicit teaching objective and thendefinitively teach, and thereafter recognize the presence or absence ofthis behavior by a student.

This elaborate definitional process may be characterized as definingdesirable knowledge by its overt behavioral representation and thenfractionating these behaviors into a digitally compatible format.

The logical process of digitizing complex subject matter has beenbeneficially employed in numerous other scientific and technicaldisciplines with the intent of harnessing the greater power ofmeasurement systems that utilize discrete detection and management logicand apparatus for iteration and compilation. Traditionally many complexphenomena that were viewed as continuous and multi-dimensional, werethought to be subject only to analogical methods of measurement, i.e.sound, light, etc. However, by applying digital techniques offragmentation into multiple distinct units, sound, light, and now, evenacademic repertoire, become addressable by systems of precise detection,measurement, and in consequence, management.

In the present invention, therefore, prior to the initiation of anacademic course of study, the subject matter of the course is analyzedin detail and broken down into a plurality of discretely definedbehavioral performances suitable for “yes-no” recognition, which arethereafter established as teaching objectives. Once compiled, the largevolume of objectives are stored in a library of learning elementscategorized by general subject matter and estimated difficulty levelavailable for selection from a classroom guidance computer.

Three sets of learning elements (teaching objectives) are depicted intable format in FIGS. 1-3, respectively, for purposes of example. Thetable of FIG. 1 depicts some of the learning units available for choiceas reading objectives for a first-grade student. Similarly, the tablesof FIGS. 2 and 3, respectively, depict sample sets of learning unitsrelevant to the teaching and learning of science and social studies fora first-grade student.

II. Establishing Performance Measurement in a Digital Format

Traditional academic planning and grading systems employed by teachersuniversally treat educational subject matter as continuous repertoireand typically attempt precision by direct analogical measurements basedon multi-dimensional standards. Subsequently, teachers average thesemeasurements in some fashion and then give one summary grade for anentire subject of study. The use of digital procedures by the presentinvention improves upon the traditional systems and methods because eachexplicit and unique objective can be accurately identified, moreuniformly taught, and the resulting learning more accurately andconsistently detected and mathematically compiled by the instructor. Astudent's performance within the classroom can not only be trained andevaluated in a more objective manner, deficiencies of performance arealso more readily identified and isolated due to the high level ofdetail and clarity by which each objective is defined.

Consider the following example to illustrate the above point. A firstgrade student's reading ability is evaluated over the course of threeweeks. Under a traditional academic planning and grading system, thestudent earns a “B+” grade for the first week, a “B” grade for thesecond week, and an “A−” grade for the third week, resulting in acumulative “B+” grade for the three week period. Except for the obviousfact that the student has earned a respectable grade, no other detailconcerning the student's reading ability, including the areas in whichhe or she may still be deficient, can be determined by the abovetraditional system.

Alternatively, over the same three week period, a second student'sreading proficiency is evaluated by the present invention, on the basisof the 20 teaching objectives listed in the table of FIG. 1. At the endof the three weeks, the second student has demonstrated proficiency in17 of the 20, or roughly 85%, of the listed objectives. In addition tothe fact that the second student has achieved a respectable level ofproficiency over the three week period, it has also been determined thatthe second student is having problems identifying the consonant soundsd, m and s (Item Numbers RE3-1 and RE4-1) and identifying consonantsthat can sound alike (Item Number RE13-1), thereby precisely indicatingwhat supplementary teaching is necessary.

Because traditional academic planning and grading systems typicallyconsider academic subject matter to be a continuous datum and thereafterassess a student's performance as a matter of degree, reliance is madeupon scales and measurement along continua. One common example, asalready demonstrated in the example above, is the “A” through “F” lettergrading scale in which a student earns a grade of “A”, “B”, “C”, “D” or“F” depending on the student's evaluated proficiency in a topic.Frequently the number of levels or degrees in this grading scale isfurther expanded by assigning a “plus” or “minus” to most of the lettergrades, such as, for instance, a grade of “B+” or “C−”.

Unfortunately, these traditional grading schemes tend to be quitesubjective in their implementation. One instructor might assess acertain level of performance by a student as deserving a grade of “A−”,while a second instructor might evaluate the exact same level ofperformance as only deserving a grade of “B+”. Because these traditionalgrading schemes are inaccurate, it is difficult to compare theperformance level achieved by two or more students. Such ambiguitieshave also stymied any development of automatic performance measurementand analysis.

The academic planning and grading system of the present inventionconfirms learning performance relative to a learning unit standard asmastered or not, i.e., as a matter of kind rather than as a matter ofdegree. When a teacher selects certain knowledge units to be thelearning objectives of the current week, a state of “teaching andlearning has begun” is automatically established for each student andeach objective chosen in the gradebook section of the classroom guidancecomputer. Then at the end of the week, each student is evaluated by theteacher in reference to the week's learning objectives. A student isevaluated on the basis of either having mastered an objective or not(roughly equivalent to a traditional grade of A or A+). Consider, onceagain, the example of a first grade student being evaluated on the basisof the 20 objectives listed in the table of FIG. 1. If the studentdemonstrates completed learning of all but one of the listed objectives,he or she would earn 19 scores of “2” and one score of “1”.

Advantages in adopting a digital, all or nothing, definitional criterionand detection system include the ability to use a single quantitativemethod and common scales to express, examine, and compare not onlyvariations in performances within a single group or class of students,but also, variations in performances in different curricula anddifferent aged students, and in different instructional settings.

The scoring system of the present invention accurately recognizes thepotential ambiguity of “0” (zero)—as indicating either a lack of masterysubsequent to teaching, or, a lack of mastery prior to teaching. This isclarified by employing a three state system: —0— “Teaching not yetbegun”; —1— “Teaching and Learning have begun”, i.e. the week'sobjectives are chosen and the week of presentation is proceeding (butlearning is not complete); —2—, “teaching and learning are complete”. Bythis method, the separate performances of teacher and student arerecorded by “1's” and “2's”.

III. A Classroom Guidance System Designed for the Teaching of SubjectMatter Prepared in Digital Format

There are several inherent consequences of redesigning the extensive andcomplex subject matter of education into large numbers of discreteunits. One is to establish both the opportunity and the imperative fortime and labor saving methods. To this end, the application of moderndigital systems and personal computers for recording basic teaching andlearning information has already been covered. The lesson planning andgradebook components described above would, by themselves, be usefuland, indeed have been developed by others in various other forms asteacher aids. In the present invention, however, they are basiccomponents of an integrated system of educational management which takesaccount of, and is adapted to several prominent consequences of thedigital design of education.

Establishing numerous, simplified, learning units, leads teachers totake frequent, specific instructional and observable actions. Sincethese responses are accomplished on a classroom computer, softwaredesign affords the opportunity to provide guidance and measurement ofthe teaching and the learning process. The academic character, temporaldimensions, and coincidence with the past and current conditions of theclassroom setting relative to teacher and student performances will berecorded and, as a result, can be reviewed by the teacher and otherresponsible managers.

In the present method, as in many educational settings, one or moreteachers and teacher assistants are primarily responsible for theeducational progress of a classroom of 10 to 20 children of generallysimilar ages and academic backgrounds. Distinct from typical classroomshowever, the present method assumes one person designated as an on siteeducation manager. In the present invention, the teacher in charge is amember of a larger management team collectively responsible for andactively participating weekly in the educational events of theclassroom. These other managers participate remotely and maintainoversight with the managing teacher by computer linkage. The classroomcomputer may be described as the classroom guidance computer while otherdistant information stations are termed the remote management computers.

The academic management system of the present invention is thusimplemented through the use of two distinct computerized databasesystems. The first computerized database resides within a local,management programmed, classroom guidance computer. The secondcomputerized database is a remote system associated with a schooldistrict office or other school administrative body, which generallyfunctions as a secondary data repository, as a data management andanalysis tool, and as an information distribution network controller forremote management participation.

To facilitate the transfer of data between the two databases, eachdatabase system connects to either a local area network (LAN) and/orwide area network (WAN). Alternatively, the two database systems maycommunicate with one another by means of a direct connection, such as,for example, a dedicated fiber optic line.

Every academic class or instructional course is divided into a number ofinstruction and evaluation periods. For purposes of this discussion, itwill be assumed that management has settled upon periods equivalent to astandard school week.

At the beginning of every week, the instructor accesses the lessonplanning portion of the classroom guidance computer and selects one ormore learning units as objectives from the management establisheddatabase. The instructor then initiates a weekly lesson plan on theclassroom guidance computer which incorporates the selected objectivesvia a software format and portrays the information on a screen.Coincidentally, these academic scheduling choices are presented onremote management computers. In an alternative embodiment, the selectionof learning units would not be carried out by the instructor, but wouldbe predetermined by the management software.

The lesson plan of the week is subsequently printed out as a WEEKLYPREVIEW report which is distributed to parents. As illustrated in FIG.4, the WEEKLY PREVIEW report includes, among other things, a listing ofthe various objectives that make up the lesson plan for that week. Inthis manner, parents are incorporated into the management group, and areinformed of the forthcoming instructional sequence prior to its onset.FIG. 4 also illustrates that the WEEKLY PREVIEW report incorporates asection for the instructor to produce communications for the parents.

Once objectives have been determined and announced to the parents, a“state change” termed “teaching has begun”, is automatically entered foreach student for the chosen objectives into the gradebook (a score of“1”).

IV. A Classroom Guidance System Suitable for Accurately Observing andMeasuring Learning of Subject Matter in Digital Format

At the end of the instructional period, (typically a week), theinstructor evaluates each student's performance for each of the period'sobjectives and enters the results into the classroom guidance computer(i.e., no entry if the student needs to continue to work on the specificobjective, or a 2 to indicate that the student has learned thoroughly(mastered) the specific objective. Evaluation results for each studentare automatically distributed to the administration computer system.Here the “2” score for “learning complete” updates the “1” score for“teaching and learning begun”. A WEEKLY EVALUATION REPORT, illustratedin FIG. 5, is then generated for each student and distributed to eachstudent's parents at the end of the week. This element of the managementsoftware design guarantees the continual parent/manager oversight tohelp assure constant examination of the educational process. Similar tothe WEEKLY PREVIEW report, the WEEKLY EVALUATION REPORT lists thespecific objectives that the class covered over the course of the week,along with the learning evaluation (i.e., grades) as well as any newcomments by the instructor.

An alternative embodiment of the system allows the instructor to accessa Classroom Teaching Chart. This establishes a real time recordingsystem for continuous use throughout the instructional week. TheClassroom Teaching Chart provides a visual representation of allstudents in the class and the current state of learning for each chosenobjective for each student. As illustrated in FIG. 6, the ClassroomTeaching Chart is organized into a series of picture panels labeledindividually with each student's name. When the teacher commencesteaching of an objective and begins observation of a student, theteacher “clicks” upon the appropriate picture panel. This action causesa cartoon-face representation of the student to appear in the picturepanel. The facial demeanor of the cartoon representation is neutral. Ascore of 1 is now entered in the grade registry indicating a state of“teaching and learning has begun”. Later, when the instructor evaluatesa student's learning progress on the objective, and a studentdemonstrates mastery, a further click on the student's picture panelcauses a change of the cartoon face from one color to another (forexample yellow to green) and a change in the facial demeanor fromneutral to broadly smiling. Alternatively, should the instructor'sjudgment be a revision from a previous estimate of mastery to anevaluation of in progress, a “click” will reverse the facial expressionsand color to their previous state.

At the top of the Classroom Teaching Chart is an additional panel whichpresents a continuously adjusted, cumulative total mastery score for theentire class of students.

The instructor may move from one objective to another at differentperiods in the day by simply clicking on the objective navigation bar(either forward or backward) near the top of the chart. When theinstructor chooses to employ this portion of the system, performanceevaluations are continuously updated. Since evaluations are alwayscurrently accurate, no separate “end of week” grading procedure isnecessary.

By use of the Classroom Teaching Chart the instructor knows immediately,and always, the current learning status of each student, and of theentire class for the objective of current classroom interest. Thecapability of this alternative embodiment for establishing an immediaterelation between a learned response and further consequences, byautomatic means, fulfills a necessary condition for learning and therebyprovides a powerful supplemental tool for the instructor. By employmentof a recording system in “real time” the system can be utilized toautomatically produce a variety of alternate nonverbal forms ofrecognition and reward of student learning performance. For example, theoccasion of an instructor recording learning mastery can producefeedback to individual students by novel signals, direct private orpublic delivery of rewards, or the automatic recording of earned rewardsin a computer assisted “bank account”.

At appropriate intervals throughout the academic year, the gradebooksystem also generates and distributes to the parents a QUARTERLYPROGRESS REPORT for each student. FIG. 7, illustrates a sample of theQUARTERLY PROGRESS REPORT, which lists the entire year's objectives andthe learning evaluation for each specific objective covered to date.

When a student is evaluated on an objective two or more timessequentially over the course of the year, the latter evaluation or gradedoes not erase the record of previous scores. Instead, all grades arerecorded and saved in their appropriate temporal position of the ongoingrecord. If, during the first quarter, a student is being taught anobjective and is scored a 1, then this grade will carry through for theentire year unless and until the student is re-evaluated at a laterpoint in time. If, for example, the student is re-evaluated during thesecond quarter on the same objective and now demonstrates learningmastery, a score of 2 is recorded. This second grade now remains for therest of the year unless the student is again later evaluated and earns alesser grade.

V. A System for Automatically Analyzing and then Frequently Presentingto Remotely Located Managers, a Complete Description of the Progress andCurrent Achievement Levels of Individual Students, Classrooms, andSchools

On Friday, the week's data for all classrooms is entered into thegradebook section of the classroom guidance computers and a servercollectively transmits the week's data to the remote administrationcomputer system. There, all the teaching and learning information foreach student is assembled into a series of information formats (graphs),which are then transmitted to selected, remote management observationstations. There, various navigation “tools” are provided to the viewerto sort, filter and display the data according to various reviewpriorities. This entire compiled, illustrated, and navigable educationaldatabase is titled THE LEARNING MANAGEMENT REPORT. A cardinal feature ofTHE LEARNING MANAGEMENT REPORT is its bidirectional organizationallowing viewer examination from the specific to the general or viceversa. Review can begin with an individual student in a selectedcurriculum, forward to progressively more generalized reports such asthe overall performance of entire classrooms for all curricula.Alternatively, the viewer may start from the general analysis and movetoward subsidiary information. This is accomplished by a ring of reportsaddressable in either direction, starting from an introductory panel.The information presentation sequence of the present invention isillustrated in FIG. 8.

Additional graphic presentations for entire multiple classroom grades,entire school buildings, etc. or alternatively, individual studentspecial instruction routines, are inserted, either as subroutines, ordirectly within the main navigation ring at the appropriate position inthe sequence. Graphic presentation may be by direct screen viewing andautomatic network distribution or by printer production and physicaldistribution. Navigation across and within data subsets is arranged byincorporating a “point and click” rubric, using the computer keyboardand/or mouse. The viewer chooses data presentation by moving the mousepointer to a specific option target as selected from a multileveldata-command target bar. Navigational options are large, highvisibility, target spaces highlighted by arrow shaped (< >) movementsignals. The user points the mouse to such a target and “clicks” thecommand button for data set advance or retreat. By using the scrollingfeature of the mouse, the viewer can extend examination through lengthyobjective sequences which are more extensive than presentable inentirety on a single screen. By this system it is possible to rapidlyscan and study entire learning repertoires for either individualstudents or entire classrooms, etc.

Considering the graphic series of reports from specific to general, thefirst presentation panel of the LEARNING MANAGEMENT REPORT, an exampleof which is shown in FIG. 9, is the report introduction cover. Thispanel is useful for background information, advisories of currentissues, etc. and log in security clearances. It also serves to positionthe viewer to begin an examination from the general or from the specificpoint of reference. The viewer begins the inquiry by “clicking” themouse on the target of interest and proceeding.

If the viewer chooses to begin with specific detail, the first reportshown is the STUDENT LOG. The illustrated example in FIG. 10 depicts asection of the STUDENT LOG for one student that provides a compendium ofthe actual teacher instructional sequences and evaluation scores foreach objective for each week, organized by curriculum groups, for allweeks of the academic year. The weekly succession of learning scores astudent receives for each specific objective is presented across thecourse of the year. The most recent score received is also “broughtforward” in an initial left hand column titled “LAST” for viewerconvenience. Four additional columns (E1, E2, E3, E4) inserted into theweekly sequence afford space for evaluations from teacher-independentsources for any or all, objectives, if and when these are available.Evaluation scores of 1 or “teaching and learning incomplete” areaccented in red to attract viewer attention. A double row space, abovethe weekly column of the screen is provided for noting supplementaryinformation or individual special tutorial actions.

The voluminous material of a student log is available in summary asillustrated in the example of FIG. 11. The summary is termed the STUDENTDIGEST and presents, weekly, for each student, a cumulative bar graphcumulating the student's progressive, level of learning, for eachcurricular area (i.e., math, science, reading, etc.), up to the currentweek of the academic year. If an instructor were to evenly introduce theobjectives of a specific curricular area over the course of the academicyear, and the student consistently mastered these objectives as theywere presented, the corresponding graph would rise in a progressive,roughly linear ascent starting from 0% at the beginning of the year andrising to 100% at the end of the year. The rate of teaching (objectiveintroduction) coupled with the efficiency of student learning (grade)together produces the total learning, and variations in either teachingor student efficiency (grade) therefore affect the learning measurepresented.

For example, a graph depicting a 90% learning level halfway through theyear (week 20), would indicate that the instructor introduced a majorityof the objectives for a specific curricular area in the first half ofthe year, and the student mastered those objectives. In contrast, agraph depicting a 25% learning level halfway through the year couldindicate one of several things; the instructor had not yet introducedmany of the objectives for a specific curricular area, or, theinstructor had introduced the objectives but the student had not yetmastered the material.

The STUDENT DIGEST depicts the general educational accomplishment todate for each student, for each entire individual curricular area, and,additionally, a more general overview of performance for the entirecurriculum. In each of the STUDENT DIGEST graphs, the angular guidelineprovides the viewer a benchmark representing the progressive learningmastery of all objectives taught to date. Additionally, the actualnumerical value for the three cardinal elements known by this invention;teaching (“TEACH”), cumulative learning (“LEARN”) and the derivedestimate of a student's learning efficiency (“GRADE”), are provided foreach curriculum grouping.

The material presented by the STUDENT DIGEST is further available assummarized, and can be referenced by the STUDENT/CLASS PERFORMANCERANGES table.

One example of this more general performance analysis is shown in FIG.12. Here, the two components of current learning performance, totallearning & learning efficiency or grade, are shown for each student in aparticular classroom for each curriculum area. This graphic presentationis formatted to initially present the data hierarchically according toeach student's overall average grade. An independent navigation targetallows the selection of alternate criterion for ranking learningperformances, either by “grade” or by “learn” scores according to thevarious individual curricular areas. Performances with an average gradebelow 75% are accented in red to attract viewer attention. This screenallows the summary examination of each individual student's totalperformance in each curricular area as well as the student's learningefficiencies (grades) referenced to other classmates.

The information contained in the three individual student performancegraphs can be summarized for an entire classroom. A running log ofentire classroom activity (FIG. 13) is provided by the CLASSROOM LOG.This summary presents, for all students as a group, the average totallearning score for each objective, for each week, organized bycurricular groups, for all weeks of the academic year. In analogousfashion to the STUDENT LOG described earlier, the CLASSROOM LOG presentsthe actual, average numerical accomplishment for the entire classroomgroup in full detail across the academic year. Presented scores aremultiplied by 10 to eliminate decimals. Here, just as with the STUDENTLOG, average group scores below 75% mastery are highlighted in red toprompt viewer attention. Just as with the STUDENT LOG, there are columns(E1, E2, E3, E4) interspersed in 4 places within the year for recordingteacher-independent information regarding performance. One feature ofthis graphic presentation is the direct portrayal of relative difficultyof different objectives for the entire class of students.

The broadest overview of general classroom performance is the CLASSROOMDIGEST. FIG. 14 illustrates an example of the CLASSROOM DIGEST whichpresents, for the entire classroom, a series of cumulative bar graphsindicating summary learning progress for each curricular area of studyup to the current week. Here, as with the STUDENT DIGEST, data issummarized across entire curricula and accumulated across the weeks ofthe school year to portray major trends in progress of accomplished(mastery) learning. In addition to the bar graphs, entire class learningperformance can also be presented in numerical terms, wherein, forexample, the total progress to date of learning (“LEARN”) is divided bythe total teaching to date associated with these learning results(“TEACH”) to yield the overall efficiency of learning (“GRADE”). Here aswell, a solid guideline from zero to 100% learning allows the viewer torapidly scan the performance of the entire class for progress throughoutthe year as it may lag or lead this standard.

Users of the LEARNING MANAGEMENT REPORT are provided with the ability torapidly move between individual student reports and group reports, aswell as across individual students, groups, grades and curricular areas.Such facility to rapidly move between different reports which are veryfrequently generated, establishes for the viewer the opportunity to spottrends, individual variations, curricular difficulties and teachingpatterns. Such analysis allows for the early detection of potentialproblems and/or opportunities that would otherwise not be seen byconventional long-intermittent academic planning and grading systems. Incontrast, THE LEARNING MANAGEMENT REPORT is always current, beingupdated at virtually the same rapid pace as the educational dynamics ofthe classroom.

What is claimed is:
 1. A computer-implemented classroom programmingmethod for overseeing and adjusting and strengthening the instruction bya teacher and learning by students during an academic year with respectto one or more topics of study for a grade level over a plurality ofsuccessive evaluation periods, comprising the steps of: analyzing asubject matter of an academic course of study in detail and subsequentlybreaking down the totality of knowledge of the subject matter that theteacher is expected to teach and each student is expected to learnduring said academic year into a plurality of discretely definedbehavioral performances that are designed to be readily and objectivelyrecognized as being mastered or not by the student; storing theplurality of discretely defined behavioral performances into a computersystem comprising at least a first computerized database system whichorganizes the plurality of discretely defined behavioral performances onthe basis of structural and functional groupings as well as conventionallevels of difficulty or advancement, said first computerized databasesystem storing a teaching and learning state score respectively for eachof said plurality of discretely defined behavioral performances, saidteaching and learning state score comprising a selected one ofsuccessive first, second and third scores wherein said teaching andlearning state score is changeable successively from said first score tosaid second score and then from said second score to said third score toindicate a current state of teaching and learning, said first scoreindicating that instruction has not begun and learning has not begun,said second score indicating that instruction has begun but actuallearning is not complete, and said third score indicating thatinstruction and actual learning are complete, each one of the pluralityof discretely defined behavioral performances having said teaching andlearning state score initially being set to said first score for each ofsaid plurality of discretely defined behavioral performances in saidfirst computerized database system prior to instruction thereof duringsaid academic year wherein said first score represents that instructionhas not begun and learning has not begun; subdividing said grade levelinto a plurality of progress intervals wherein each said progressinterval is subdivided into a plurality of said evaluation periods; foreach specified one of said evaluation periods of the classroom,developing a teaching and learning plan by designating one or more ofthe discretely defined behavioral performances stored in the firstcomputerized database as learning objectives for said teaching andlearning plan that are to be taught by the teacher and learned by thestudents during said evaluation period; after said designation of saidlearning objectives of said teaching and learning plan, changing saidteaching and learning state score for each respective one of saidlearning objectives by successively replacing said first score in saidfirst computerized database with said second score to represent thatinstruction of each said learning objective has begun but actuallearning is not complete; instructing said learning objectives of saidteaching and learning plan during said evaluation period; through theend of each specified one of said evaluation periods, said teacherevaluating a performance of each student during said specifiedevaluation period to determine an actual ability of each of the studentsduring the course of said evaluation period to carry out the one or morediscretely defined behavioral performances designated as said learningobjectives over the course of the evaluation period and recording theresults of the evaluation in real time into the first computerizeddatabase system by either retaining said second score as said teachingand learning state score or else replacing said second score with saidthird score to indicate whether each of the teachers and students hasprogressed from teaching and learning not complete to teaching andlearning complete for each of the learning objectives, said recordingbeing performed by either changing said teaching and learning statescore by replacing said second score with said third score for each saidlearning objective evaluated as teaching and learning complete, or elsemaintaining said teaching and learning state score as said second scorefor each said learning objective evaluated as teaching and learning notcomplete; automatically generating a dynamic classroom teaching chart bysaid computer system during said evaluation period providing a real timevisual representation of each of the student's learning progress for oneor more of the learning objectives for the specified evaluation periodwherein said real time visual representation corresponds to the selectedone of said first, second and third scores currently stored as saidteaching and learning state score; updating said dynamic classroomteaching chart continuously during said evaluation period upon eachchange of a said student's learning progress from teaching and learningnot complete to teaching and learning complete for each of said learningobjectives by changing said teaching and learning state score byreplacing said second score with said third score for each said learningobjective evaluated as learning complete; visually presenting saiddynamic classroom teaching chart by said computer system on a displayduring the course of said evaluation period to automatically show eachupdate of said dynamic classroom teaching chart upon each change of asaid student's learning progress and to show the current teaching andlearning state status of said learning objectives as learned asindicated by said third score or not learned as indicated by said secondscore; and said computer system including a second computerized databasesystem, wherein at the end of each specified evaluation period,automatically transferring the recorded results of the evaluation fromsaid first computerized database system to said second computerizeddatabase system that collects evaluation results for each teacher andstudent, for every evaluation period, for every class, and automaticallyorganizes the plurality of collected evaluation results into aninteractive learning management report that is presented to a reviewerin real time to display a variety of levels of detail ranging from aspecific level, including a specific subject matter for a specificteacher and student, to a general level of detail, including the overallperformance of a classroom or school over a specified period of time;continual parent or guardian oversight of the teacher's and student'sprogress and performance is maintained by the additional steps of:generating a preview report at the beginning of each specifiedevaluation period respectively for the teacher and each student anddistributing the respective preview report to at least one parent orguardian of each student, said preview report listing each of thelearning objectives designated for instruction for the specifiedevaluation period for said student; generating an evaluation report atthe end of each specified evaluation period respectively for the teacherand each student and distributing the respective evaluation report to atleast one parent or guardian of each student, said evaluation reportlisting each of the learning objectives designated for instruction forthe specified evaluation period along with the associated evaluationresults of the teacher's and student's performance for the specifiedevaluation period as indicated by said teaching and learning state scorefor each of said learning objectives.
 2. The method according to claim1, further comprising the step of strengthening a learning performanceof the student by automatically presenting, directly to the studentduring said evaluation period, at least one of a non verbal recognitionand other reward for learning progress.
 3. The method according to claim1, wherein the dynamic classroom teaching chart provides a real timevisual representation of the actual teaching and learning progress foreach teacher and student and for the entire class during said evaluationperiod by continuously updating said dynamic classroom teaching chart bysaid computer system and said computer system displaying an indicationof the teaching and learning state status of said learning objectives aslearned or not learned.
 4. The method according to claim 3, wherein saidcomputer system operates such that the dynamic classroom teaching chartdisplays a real time, continuously adjusted, cumulative total masteryscore for a teacher and an entire class of students for one or moreselected learning objectives in combination with said displayedindication of said teaching and learning state status of said learningobjectives.
 5. The method according to claim 1, wherein at least one ofthe preview report and evaluation report further includes a commentssection for remarks made by an instructor and directed to the parent orguardian.
 6. The method according to claim 1, wherein said first scoreis a zero, said second score is a one, and said third score is a two,and wherein each teacher and student has said teaching and learningstate score for each said learning objective changed by said computersystem from zero to one in the beginning of instruction and then fromone to two by said computer system for any of the learning objectivesevaluated as learning complete upon being evaluated with respect to anyone learning objective to indicate the teaching and learning statestatus of said learning objective.
 7. The method according to claim 6,wherein: a score of zero represents that instruction of that specificlearning objective has not yet begun; a score of one represents thestatus of teaching and learning not complete indicating instruction ofthat specific learning objective has begun but that learning is not yetcomplete; and a score of two represents the status of teaching andlearning complete indicating instruction and learning of that specificlearning objective is complete.
 8. The method according to claim 1,wherein the first computerized database system resides within a locallymanaged computer of said computer system that is locally managed withrespect to the classroom, while the second computerized database systemresides within a remote computer of said computer system associated witha school district office or other school administrative body forgeneration and distribution of said evaluation report to said parent orguardian of said student and said learning management report to teachersand managers.
 9. The method according to claim 8, wherein the remotecomputer generally functions as one of a secondary data repository, adata management and analysis tool, and an information distributionnetwork controller for remote management participation.
 10. The methodaccording to claim 8, wherein the locally managed computer and theremote computer connect to at least one of a local area network (LAN)and wide area network (WAN), or alternatively, connect to each other bymeans of a direct connection.
 11. The method according to claim 1,wherein said teacher selects one or more of the discretely definedbehavioral performances for designation as a said learning objective.12. The method according to claim 1, wherein the first computerizeddatabase selects one or more of the discretely defined behavioralperformances for designation as a said learning objective on the basisof at least one predetermined criteria.
 13. The method according toclaim 1, wherein said progress interval is a quarterly period of theacademic year comprising a plurality of said evaluation periods, eachextending at least a week, and the method further comprising the step ofautomatically generating a quarterly progress report by said computersystem for each teacher and student at appropriate ones of said progressintervals throughout an academic year, the quarterly progress reportlisting all selected learning objectives for the academic year, as wellas the evaluation results for that teacher and student for each specificlearning objective covered to date wherein each of said selectedlearning objectives includes an indicator associated therewithrepresenting said teaching and learning state score of either said firstscore, said second score or else said third score for each said learningobjective and each said specified evaluation period.
 14. The methodaccording to claim 1, wherein if a teacher and student are evaluated ona learning objective two or more times over the course of an academicyear, the latter evaluation result is recorded as either said secondscore or else said third score at the appropriate temporal positionwithin an ongoing record and does not erase any previous evaluationresults.
 15. The method according to claim 1, wherein the step oforganizing the plurality of collected evaluation results into a learningmanagement report further comprises the step of generating a student logby said computer system that provides a compendium of instructionalobjectives introduced to date, along with the associated evaluationresults of the teacher and student for each learning objective for eachspecified evaluation period, organized by curriculum groups, for anentire academic year.
 16. The method according to claim 1, wherein thestep of organizing the plurality of collected evaluation results into alearning management report further comprises the step of generating astudent digest by said computer system that presents, for each teacherand student, a cumulative bar graph depicting a teacher's and student'sprogressive level of teaching and learning for each curricular area ofstudy over a successive plurality of said evaluation periods.
 17. Themethod according to claim 1, wherein the step of organizing theplurality of collected evaluation results into a learning managementreport further comprises the step of generating a student/classperformance ranges table by said computer system wherein said computersystem calculates and said student/class performance ranges tabledepicts, for the teacher and for each student within a specified class,the percentage of learning objectives learned to date for each specificcurriculum group, as well as the teacher's and student's learningefficiency for that curriculum group, and the teacher's and student'soverall evaluation results, represented as a percentage, for allcurriculum groups.
 18. The method according to claim 1, wherein the stepof organizing the plurality of collected evaluation results into alearning management report further comprises the step of generating aclassroom log by said computer system wherein said computer systemcalculates and said classroom log depicts an average total score for theevaluation results of a teacher and class as a whole, for eachevaluation period, for each learning objective.
 19. The method accordingto claim 1, wherein the step of organizing the plurality of collectedevaluation results into a learning management report further comprisesthe step of generating a classroom digest by said computer systemwherein said computer system generates and said classroom digestpresents, for an entire classroom, a cumulative bar graph depicting theteacher's and classroom's progressive level of teaching and learning foreach curricular area of study.
 20. A computer implemented method toequip distant school administrators to remotely establish, monitor andassure an annual production of learning over a school year by one ormultiple classrooms each comprising teacher and student participants,the method comprising the steps of: remotely developing an academic planby employment of a computer system comprising a computerized primaryclassroom database system and a computerized secondary remote databasesystem, and imposing upon the classroom with said remote database systema detailed, unambiguous annual assignment of learning requirements forthe production of learning by the classroom; remotely standardizing,regulating and overseeing expected result, procedural sequences andschedule of the classroom learning production, said classroom learningproduction being implemented by a computer-based learning productionprocess implemented by said primary classroom database system and saidsecondary remote database system; remotely measuring the classroomlearning production by recording individual teaching and learningobjectives by said primary classroom database system and measuringteaching and learning progress and teaching and learning results in theclassroom by said secondary remote database system which automaticallyreceives and processes data received from said primary classroomdatabase system; integrating a system of real-time recording andtracking of learning and teaching production in the classroom into thelearning production process by recording and tracking teaching andlearning with said primary classroom database system; automatically andremotely adjusting the progress of teaching to variations in theprogress of learning; and remotely tracking and assimilating learningproduction throughout the school year in one or multiple classrooms bysaid secondary remote database system; wherein measuring the classroomlearning production by measuring teaching and learning progress andteaching and learning results in the classroom is remotely accomplishedby the additional steps of: management employing a measurement structurewith features sensitive to the condition that: (1) classroom learningproduction is the terminal result of an extended cooperative jointprocess of teacher and student that can be termed “teaching andlearning”; (2) measurement incorporates identification of thiscooperative process, as well as the individual contribution of theteacher and student participants, as well as the final result of theindividual and combined effort of the teacher and student participants;(3) defining features of performance measures are sufficiently clear anddistinct to assure high measurement reliability; (4) units ofmeasurement are suitable to sensitively detect the small changes ofprogress which may occur in brief classroom intervals; (5) the units ofmeasurement are suitable to aggregate across many observations; and (6)the measures are a three term nominal measurement scale of threecategories, comprising categories A, B and C respectively defined bystates “0”, “1” or “2” wherein: category A corresponds to said state “0”which equals “teaching (instruction) and learning not begun” which isthe state existing when the classroom is in session but neither saidstate 1 nor said state 2 exist; category B corresponds to said state “1”which equals “teaching (instruction) and learning begun” which is themeasured state existing when the classroom is in session, the teacherhas introduced the required learning performance objective to a specificstudent but state “2” does not exist for the particular objective; andcategory C corresponds to state “2” which equals “teaching (instruction)and learning complete” which is the measured state existing when theclassroom is in session, the teacher has introduced a required learningperformance objective to a specific student and the teacher concludesteaching and that student demonstrates complete performance of thelearning performance objective; and wherein the step of remotelystandardizing, regulating and overseeing the procedural sequences andschedule of the classroom learning production are accomplished by theadditional steps of: management assigning to the classroom, intermediatematerials and activities required to produce completed teaching andlearning in the form of a classroom computer guidance system defined bysaid primary classroom database system and comprising a series ofinteractive classroom objectives display screens, which promptmanagement-specified teacher performance, in a management specifiedfixed order, according to management specified time periods throughoutthe school year; and by interconnection with additional computer systemsdefined by said secondary remote database system at other managementstations, maintaining real-time oversight of each step and result of theclassroom learning production by: 1) establishing as a first requiredstep, that the teacher designate on a computer system provided WEEKLYPREVIEW screen, each teaching and learning objective of a current weeklyproduction cycle from a library of objectives to define a planned weeklyproduction schedule, then composing parent announcements, on thecomputer system provided WEEKLY PREVIEW screen, then posting a completedproduction schedule, automatically by printed report to all parents, andautomatically by computer network to all management stations; saidposting also entering, automatically for all students, a score of “1” ona computer system provided WEEKLY EVALUATION REPORT, without additionalquery and thereby recording “teaching and learning has begun” there onthe classroom computer guidance system as a learning state score of “1”and also to said secondary remote database system accessed at the remotemanagement stations to indicate that the teaching and learning hasbegun; 2) the teacher and students thereafter commencing teaching andlearning of each designated objective for the weekly learning productioncycle, and entering and revising said teaching and learning state scoresbefore the end of the weekly learning production cycle; 3) choosing oneof the designated weekly objectives listed on the interactive displayscreen for a CLASSROOM TEACHING CHART and, entering in said primaryclassroom database system for each student a “1” as teaching andlearning for that student commences, proceeding thereafter through eachdesignated objective in the “1” state of teaching and learning, whilesimultaneously observing and recording with each student whetherlearning is mastered or not and when present, entering a score of “2” insaid primary classroom database system indicating “teaching and learningcomplete” which is automatically posted by said computer system withoutadditional query to the classroom WEEKLY EVALUATION REPORT and remotemanagement station computers; and 4) at the end of the weekly learningproduction cycle, referencing the WEEKLY EVALUATION REPORT, auditing thecompiled teaching and learning state scores for every designatedobjective, and for each attending student, composing and entering parentproduction results announcements therein, and posting the WEEKLYEVALUATION REPORT automatically by communications to parents andautomatically without additional query in real time by computer networkto all of the management stations, such that a manager is continuouslyinformed of the planned weekly production schedule, as well as minute byminute progress through the production schedule and the end-of-weekschedule production results.
 21. The method according to claim 20,wherein said detailed, unambiguous annual assignment of classroomlearning production is established by the additional steps of:management composing and establishing in said secondary remote databasesystem said detailed, unambiguous annual assignment for each grade leveland for each chosen general knowledge area by: 1) creating or adaptingfrom published sources, a rational subdivision of each knowledge areaaccording to natural, or culturally practiced, structural and functionaldistinctions, into fractional portions of the knowledge area; 2) furtherdividing each fractional portion into a plurality of discrete componentswhereby each component has a component description which is: (A) adescription of an overt behavior which may be demonstrated orexemplified by a said teacher and, with practice, perfectly imitated soas to be mastered, by a said student; (B) is related to, and practicallyfollows and precedes other of said components; (C) is easily recognized,and distinguished by any alert independent adult observer, as beingpresent or absent in a teacher's or student's performance withoutrequiring any further fractionation to improve recognition; (D) thecomponents are used individually or as combinations together; (E) theplurality of discrete components are hierarchically organized accordingto a best order of teaching and learning; and (F) span a range of saidcomponents sufficient to adapt to individual differences in historicgrade level preparation; and 3) subsequently the school administratorestablishing a detailed, unambiguous classroom learning syllabus, alongwith all other syllabi appropriate to a particular classroom, in adeclarative manner suitable to establish such syllabi to be theclassroom learning assignment, by installing these syllabi into saidprimary classroom database system to establish the annual assignment ofclassroom learning production, said annual assignment being continuouslymonitored and adjusted relative to current teaching and learningproduction automatically by said computer system.
 22. The methodaccording to claim 20, wherein the step of automatically and remotelyadjusting the progress of teaching to variations in the progress oflearning is accomplished by the additional steps of: establishingclassroom conditions where teaching and learning production proceeds bysmall objectives across frequent, brief production periods by thefollowing step: permitting a teacher to observe from the WEEKLYEVALUATION REPORT displayed on a classroom screen, or from a weeklyupdate of a STUDENT LOG screen of a LEARNING MANAGEMENT REPORT for anyparticular learning objective, for an individual student, the measuredstate teaching and learning state score of “1” wherein the teacher isthereby automatically prompted by a persistent indicator prior to thenext weekly production plan cycle to continue teaching and learning thatobjective in a forthcoming one of said weekly production plan cycle. 23.The method according to claim 20, wherein the capability for remotelytracking and assimilating learning production throughout the school yearin one or multiple classrooms is accomplished by the additional stepsof: employing a computer server and network connected to each saidprimary classroom database system in a remotely-located plurality ofsaid classrooms and to a management server computer system whichcomprises said secondary remote database system to directly accept inreal time, all information generated at each said classroom, andoperating system software to store, aggregate, condense, summarize,abstract and update said information across each school week of theschool year to define formulated information, and remotely display suchformulated information at a manager's computer station; automaticallywithout additional query providing a composite report which isthematically organized to display teaching and learning information frommost general to most specific as referenced respectively from a longestto a shortest time sample, thus permitting user friendly dataexamination and management preparedness, to generate a LEARNINGMANAGEMENT REPORT, said LEARNING MANAGEMENT REPORT comprising: a CLASSDIGEST screen which pictorially presents on a computer displayaccumulated episodes of teaching and learning for all students, of alllearning units of each curricular area, accumulated across the schoolweeks of the school year, the display separately depicting totalteaching, a rate of teaching, teaching efficiency, rate of learning,total learning, and learning efficiency for all subject matter and forall students of the classroom combined, such that where these classroomdynamics may fluctuate throughout the school year, a manager canfrequently observe temporal trends of production, and total teaching andlearning production of the classroom including its teacher and students,and by selection, other said classrooms which promptly alerts themanager to classroom production problems; a CLASS LOG screen whichdisplays the same information as said CLASS DIGEST but is expanded toreport for each said objective by options which are the same as saidCLASS DIGEST, but as tabular numerical data arranged temporally inleft-to-right rows reflecting productions weeks and arranged bystandards in columns, said data providing necessary information topermit audit calculations, observation of the temporal trends and/or aserial order of the objectives of teaching and learning, and specialinvestigations of the functionality of individual objectives andsuitability of the order of presentation of the objectives; aPERFORMANCE RANGES screen which displays average learning efficiency andtotal learning accumulated across all school weeks to date, for eachstudent of a classroom within a group ranked high to low, according tooverall curriculum or if selected, any specific curriculum and by eithertotal learning or learning efficiency, thereby permitting a manager toobserve the learning efficiency or total learning of a student as rankedrelative to other classmates, according to any curricular area, therebyproviding the information necessary for management to promptly assignspecial remedial or accelerating learning; a STUDENT DIGEST screen whichpictorially presents, for each individual student, the cumulativeepisodes of teaching and learning, within each curricular area, acrossall attendance weeks and thereby, separately depicts total teaching,rate of teaching, teaching efficiency, rate of learning, total learning,learning efficiency related to individual student, thereby permittingthe manager to witness the temporal trends of production progress andunwarranted variations with any particular student, in preparation formanagement adjustments; a STUDENT LOG which presents the sameinformation but expanded to report for each objective, by the sameoptions, as the STUDENT DIGEST but as tabular numerical data, temporallyarranged in left to right rows reflecting production weeks and incolumns by objective, to allow audit calculations, and facilitatingreview of the temporal pattern of both teaching and learning of anindividual student or subgroup of students perhaps requiring specialguidance; and classroom procedures screens, said screens including aWEEKLY PREVIEW screen and a WEEKLY EVALUATION SCREEN comprising the realtime, remotely generated, classroom learning production procedures whichinstantaneously report the establishing conditions and ongoing detailsof teaching and learning progress within the classroom as occurring atthe moment, permitting the manager to relate the antecedent classroomconditions to production outcomes, thereby guiding the search forprimary causes of learning production difficulty.